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Sir 

The Appellant respectfully submits this Reply Brief in response to die Examiner's 
Answer mailed on June 1 1, 2008, and thus this Reply Brief is timely filed within two months 
of the Examiner's Answer. 
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I. Status of Claims 

Claims 1-12, 14-20, 22, and 23 are pending in the present application. 
Claims 13 and 21 nave been canceled. 
Cairo 22 is allowed 

Claims 4- 1 2 and 1 6-20 are objected to but have been indicated as being allowable if 
rewritten to include all of the limitations of the base claim and any intervening claims. 
Claims 1-3, 14, 15, and 23 Stand rejected. 

Pursuant to 37 C.F.R. § 41.37, the Appellants hereby appeal the Examiner's decision 
finally rejecting Claims 1-3, 14, 15, and 23 to the Board of Patent Appeals and Interferences. 
Therefore, Claims 1-3, 14, 15, and 23 of this application are at issue on this appeal. 
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TI. Grounds of Rejection to be Reviewed on Appeal 

Whether Claims 1-3, 14, 1 5, and 23 should have been rejected under 35 U.S.C. § 
103(a) as being unpatentable over WO 02/089062 to Kimmcl ct al. (hereinafter "Kimmel et 
si.") in view of the disclosure contained in the background section of the present 
Specification (hereinafter "admitted prior an") and further in view of U.S. Patent Application 
Publication No. 2004/0091 164 to Sakatani et al. (hereinafter "Sakatani ct al."). 

in the Appeal Brief; the Appellant erroneously indicated that the grounds of rejection 
to be reviewed on appeal included review of the "Requirement for Information" under 37 
C.F.R. § 1 . 1 05 and whether the drawings should have been objected to under 37 C JP Jt § 
1 .83(a) for allegedly fail ing to show the features of Claims 14-20 and 22. The Appellant 
therefore withdraws those grounds of rejection from the present appeal. 
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III. Argument 

Claim? 1-3 and 23 

Kimmel et al. Fails to Disclose a Non-Linear Illumination Estimation Module 
The Examiner asserts that "figure 2 of Kimmel shows an iterative estimator 104 that 
estimates illumination using a non-linear max operation as shown on page 3." This assertion 
is improper and mischaractcrizcs the iterative estimator 104 described in Kimmel ct al. (WO 
02089062). 

la making this argument, the Examiner refers to lines 1 9-27 in page 3 of Kimmel et 
al. That section of Kimmel et al. pertains to the background section of the Kimmel et itL 
patent and although Kimmel et al. docs not explicitly state that the iterative estimator 104 
docs not perform the described "'reset* non-linearity", there is nothing in that section to 
indicate that the iterative estimator 1 04 performs the "non-Iincar (mux) operation" described 
therein. In fact, it appears that Kimmel et aL seeks to improve upon the approach described 
in that section as evidenced by the discussion on lines 28-3 1 on page 3. 

Instead, Kimmel et al. discusses the iterative estimator 1 04 on lines 1 7-1 9 of page 6 as 
an "image processing module 1 04 [that] uses a Projected Normal Steepest Descent or similar 
algorithm, with multi-resolution processing, to compute an estimate 107 of the iUummation, 
designated in Figure 2 as /*." Thus, there is no clear indication that the image processing 
module 104 estimates illumination using a non-linear max operation as asserted by the 
Examiner. 
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Regardless of the Discrepancy in tlte Rejection, the Examiner has Failed to 
Establish Obviousness of Down-sampling Input Images in Kimmet et ah 

The Examiner argues that it would have been obvious to replace the linear 
illumination estimation module 30 (depicted in Figure 2 of the present application) with the 
log module 102 and the iterative estimator 104 (depicted in Figure 2 of Kimmcl et al.). (Sec 
Examiner's Answer, page 9, lines 1 9-21). There is some discrepancy in this argument 
because the Examiner also argues that the "non-linear estimation device of Kimmcl includes 
log module 102, non-linear module 104, and summer 108". (See Examiner's Answer, page 
4, lines 17 and 18). It should be noted that Kimmel et aL never refers tD the iterative 
estimator 104 (or image processing module 104) as a "non-linear module 104", and that, the 
Examiner has named the element 1 04 as such. As discussed above, the Examiner has 
mischaracterized the image processing module 1 04 as using a non-linear max operation. 

Assuming that the Examiner intended to replace the linear illumination estimation 
module 30 with the log module 102, non-Iincar module 104, and the summer 108 as stated on 
page 4, lines 17 and 18 of the Examiner's Answer, the proposed combination fails to disclose 
the asserted features of Claims 1 and 23. Kimmel et al. discusses on page 6, lines 1 9*23, that 
the estimate 1 07 of the illumination is combined with the output 1 03 (a*) at summer 1 08 to 
produce an estimate 109 of the reflectance (r*), which "is converted from a logarithm to its 
corresponding base number value al exponential module 1 10, to produce a number value as 
an estimate 11 1 of the reflectance (designated as R*)." In other words, Kimmel et al. 
discloses that the summer 1 08 combines the estimate 1 07 of illumination (/*) with an output 
1 03 f>) to produce an estimate 109 of the reflectance (r*). As such, the combination 
proposed by the Examiner would result in the input into the up sample module 34 (Figure 2 
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of the present application) comprising the reflectance (r*) and not an interim illumination 
estimation as claimed in Claims 1 and 23 of the present invention. 

Assuming that the Examiner intended to replace the linear illumination estimation 
module 30 with the log module 102 and non-linear module 104, without the summer 108, as 
stated on page 9, lines 19 and 20 of the Examiner's Answer, the Examiner has failed to 
establish that the proposed combination is proper and would yield the present invention as 
claimed in Claims 1 and 23. 

The Examiner asserts that it would have been obvious to down-sample input images 
prior to inputting the input images into the log module 102 of Kimmel et al. This assertion ts 
improper because the Examiner has failed to provide any evidence that one of ordinary skill 
would have been motivated to both down-sample images and produce logarithms of the 
down-sampled images. Instead, the Examiner has merely stated that down-sampling is 
desirable as a means for speeding up the computationally intensive Rctincx process. 

Sakatani et al, fails to make up for the Deficiencies in Kimmel et al. 

Although the Examiner acknowledges that Kimmel et al. fails to disclose an 
upsampling module as claimed in Claims I and 23, the Examiner argues that Sakatani ct al. 
(US 2004/0091 1 64) and the alleged admitted prior art disclose these features. In addition, the 
Examiner argues that the discussion contained on paragraph 118 of Sakatani et al. and on 
page 3 of the present application, disclose "an upsampling module that uses the input image 
as a guide in the interpolation for the benefit of performing Rctincx type processing...". 

Initially, even assuming for the sake of argument that the combination of Kimmel ct 
al., Sakatani et al., and/or the alleged admitted prior art proposed by the Examiner is proper, 
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the proposed combination finis to make up for the other deficiencies in Kimmel ct si. 
discussed above. More particularly, for instance, the proposed combination fails to disclose a 
non-linear illumination estimation module that receives sub-sampled images as claimed in 
Claims 1 and 23. 

Secondly, as discussed in the Appeal Brief, paragraph 118 of Sakatani et al. recites 
that the resolution of the original and blurred images are matched with each other to execute a 
Single Scale Retinex calculation. More particularly, that paragraph states that the resolution 
of a blurred image is changed to match the resolution of an original image by interpolation. 
As such, Sakatani ct al. discloses that the resolutions of images arc matched with each other 
and thus docs not disclose that interim illumination estimations are interpolated to produce an 
illumination estimation by using an input image as a guide in the interpolation. For at least 
the foregoing reasons, the proposed combination of Kimmel et al. and Sakatani et al. mils to 
disclose all of the features of independent Claims 1 and 23. 

The Examiner's discussion from the alleged admitted prior art regarding "'using the 
high resolution input image S to select corresponding output pixels' when 'the interpolation 
is performed on a set of smooth, low resolution intermediate images"* pertains to illumination 
manipulation module 20 and not to the up-sampling module 34. This is clearly evidenced in 
Figure 2, which depicts the high resolution images V and the high resolution input image S 
being inputted into the illumination manipulation module 20. As such, that cited passage of 
the alleged admitted prior art also fails to disclose an up-sampling module that is configured 
to interpolate interim iUumination estimations to produce an illumination estimation by using 
an input image as a guide in the interpolation. 
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The Examiner's response to this argument is that "[t]he fact that the admitted prior art 
uses the original image as a guide in interpolation performed by the illumination 
manipulation module 20 docs not preclude an engineer of ordinary skill in the art from using 
the original image as a guide in the interpolation pea-formed by the up-sampling module 34, as 
taught by Sakatani in paragraph 1 17." (Examiner's Answer, page 11, lines 3-7). This 
response is confusing at best and improper at worst From this response, the Examiner 
apparently agrees that the alleged admitted prior art fails to disclose that the up-sampling 
module 34 performs an interpolation using the original image as a guide, but the Examiner 
still rejects Claims 1 and 23 as if the up-sampling module 34 uses the original image as a 
guide in the interpolation. (See, Examiner's Answer, page 6, lines 12-14). Thus, it is not at 
all clear AS to £dw -the Examiner has interpreted the admitted prior art 

For at least the foregoing reasons, it is respectfully submitted that the proposed 
combination of Kimmcl ct al., the admitted prior art and Sakatani et al. fails to disclose each 
and every clement claimed in Claims 1-3 and 23 of the present invention. Accordingly, 
assuming only for the sake of argument that one of ordinary skill in the art were somehow 
motivated to combine these disclosures as suggested by the Examiner, the proposed 
combination would fail to disclose all of the features of the claimed invention. Clearly, 
therefore, the proposed combination foils to teach or suggest all of the claimed elements, and 
thus, the Examiner has failed to establish a prima facie case of obviousness based upon these 
documents. 
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S. Claims 14 and IS 

In the Official Action dated September 4, 2007, in rejecting Claim 14, the Examiner 
asserted that Kimmcl ct al. discloses "producing one or more low resolution input images by 
sub-sampling the high resolution input image, generating an interim illumination estimation 
for each of the one or more low input resolution images, and producing a Rerincx corrected 
output" (page 6, lines 1 5-18). As argued in the Appeal Brief, the Examiner failed to identify 
which sections of Kimmcl ct al. the Examiner relied upon in setting forth this rejection and 
thus, this rejection is improper. In response to that argument, the Examiner has stated that 
"Claims 14 and 15, which have elements similar to apparatus claims 1 and 3 expressed in 
method form, are rejected for reasons given in the rejection of claims 1-3." (Examiner's 
Answer, page U, lines 11-16). 

However, on page 7, lines S-21, the Examiner has apparently changed his position by 
withdrawing the assertion that Kimmcl ct al. discloses any of the claimed features in Claim 
14. More particularly, there is nothing in the rejection of Claim 14 that references Kimmei et 
al. and it is not at all understood why Claim 14 was rejected based upon the disclosure 
contained in Kimmei et al. In fact, it appears that the Examiner has modified the rejection of 
Claim 14 to be based solely on alleged admitted prior art and the disclosure contained 
Sakatani et al., thus removing any reliance on Kimmei ct al. One result of this change is that 
the rejection set forth on page 7 is improper and confusing. 

For instance, if the Examiner is now asserting that the admitted prior art discloses all 
of the features of Claim 14, then it is unclear as to how or why one of ordinary skin in the art 
would have been motivated to modify the alleged admitted prior art as argued in the last 
paragraph of page 7 in the Examiner's Answer. In addition, it is not at all clear as to which 
10 
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Illumination estimation the Examiner is referring in that paragraph. For at least this reason, 
the rejection of Claim 14 is confusing and improper and should thus be withdrawn. 

The Examiner has now argued that the alleged admitted prior art discloses all the 
features of Claim 14. However, the Examiner also relics upon the disclosure contained in 
Sakatani et al. In addition, although the Examiner agrees that the alleged admitted prior art 
fails to disclose that the up-sampling module 34 performs an interpolation using the original 
image as a guide, the Examiner still rejected Claims 14 and IS as if the up-sampling module 
34 uses the original image as a guide in the interpolation, (See, Examiner's Answer, page 6, 
lines 12-14). Again, the rejection is unclear and should be withdrawn. 

in any regard, the rejection of Claims 1 4 and 1 5 is clearly improper for at least the 
reasons presented above with respect to Claims 1-3, and 23. More particularly, for instance, 
the alleged admitted prior art fails to at least disclose that an mlcrim illumination estimation 
is generated for each of one or more low resolution images, and generating an illumination 
estimation suitable forRetincx-type correction by up-sampling the interim illumination 
estimations by combining the input image and the interim illumination estimations. 
In addition, Sakatani et al. fails to make up for the deficiencies in the alleged admitted prior 
art. For instance, paragraph 1 1 8 of Sakatani et aL recites that the resolution of the original 
and blurred images arc matched with each other to execute a Single Scale Retinex 
calculation, which indicates that the resolution of a blurred image is changed to match the 
resolution of an original image by interpolation. As such, Sakatani et al. discloses that the 
resolutions of images ore matched with each other and thus docs not disclose that mtcrim 
illumination estimations are interpolated to produce an inumination estimation by using an 
input image as a guide in the interpolation. For at least the foregoing reasons, the proposed 
11 
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combination of the alleged admitted prior art and Sakatani et al, mils to disclose all of the 
features of independent Claim 14. 

For at least the foregoing reasons, it is respectfully submitted that the proposed 
combination of Kimmel ct al., the alleged admitted prior art, and Sakatani et al. fails to 
disclose each and every clement claimed in Claims 14 and 15 of the present invention. 
Accordingly, assuming only for the sake of argument that one of ordinary skill in the art were 
somehow motivated to combine these disclosures as suggested by the Examiner, the proposed 
combination would fail to disclose all of the features of the claimed invention. Clearly, 
therefore, the proposed combination fails to teach or suggest all of the claimed elements, and 
thus, the Examiner has failed to establish a prima facie case of obviousness based upon these 
documents. 
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IV. Conclusion 

For at least the reasons given above, the rejections of Claims 1-3, 14, 15, and 23 are 
improper. The Appellant therefore respectfully requests that the Board of Patent Appeals and 
Interferences reverse the Examiner's decision rejecting Claims 1-3, 14, 15, and 23 and to 
direct the Examiner to pass the case to issue. 



Respectfully submitted. 



Dated: August 1 1, 2008 




Timothy B.Kang 
Registration No.: 46,423 



MANN AVA & KANG, P.C. 

1 1240 Waplcs Mill Road 

Suite 300 

Fairfax, VA 22030 

(703) 652-3817 

(703) 865-5150 (facsimile) 
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